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STJMMARY 

t 

The  functional  equation  technique  of  dynamic  programming 
la  applied  to  the  etudy  of  quadratic  functionals  whose  Euler 
variational  equations  are  linear  self-adJolnt  partial  dlffe  r- 
entlal  equations  of  the  ae^ond  order.  A  first  consequence  Is 
the  classical  Hadamard  variational  formula  for  the  Green’s 
function  of  a  region.  Some  extensions  are  Indicated. 
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DYNAMIC  PROORAMMINO  AND  THE 
VARIATION  OP  GREEN'S  FUNCTIONS 

Richard  Bellman  and  Howard  Osborn 

1 .  INTRODUCTION 

In  an  earlier  paper  [l] ,  the  functional  equation  tech¬ 
nique  of  dynamic  programming  was  applied  to  obtain  a 
variational  equation  for  a  Green's  function  corresponding  to  a 
second  order  ordinary  differential  equation.  In  the  present 
paper,  this  method  is  extended  to  apply  to  elliptic  partial 
differential  operators,  and  a  first  consequence  Is  the  classical 
Hadamard  variational  formula.  Further  results  require  a  more 
high  powered  argumentation  which  we  shall  present  subsequently. 

•nie  technique  presented  here  utilizes  the  principle  of 
optimality  (see  [2]  )  In  the  following  fashion.  Given  a  one- 
parameter  family  of  regions,  monotone  under  Inclusion,  one 
takes  the  minimum  value  of  a  certain  Integral  on  any  given 
region  R,  subject  to  certain  restrictions,  to  be  functional 
of  those  restrictions  and  the  region  R.  Then  If  R*  c  R 
the  functional  on  R  can  be  approximated  by  means  of  a  related 
functional  on  R*  satisfying  slightly  different  restrictions. 
Ihls  leads  to  a  Gateaux  difference  equation  from  which  one 
easily  derives  the  Hadamard  relation. 

The  method  Is  Initially  presented  foi’  the  Laplace  operator 
on  R,  and  appropriate  generalizations  are  Indicated  In  ^6 
and  ^7. 
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2 .  PRELIMINARIES 

L«t  R  be  a  bounded  connected  region  of  n-dlmenslonal 
real  euclidean  space,  whose  boundary  dR  Is  of  class  C^. 

For  convenience  we  shall  not  explicitly  write  out  the 
differentials  of  volume  and  surface  area  In  Integrals  over  R 
and  3R.  Olven  any  twlce-dlfferentlable  function  u  on  R, 
let  ^u  and  u^  represent  the  Laplaclan  of  u  and  the 
restriction  of  u  to  Its  limiting  values  on  3R,  respectively. 
Then  If  v  and  w  are  suitable  functions  on  R  and  3R,  the 
boundary  value  problem 


(1) 


Au  -  V,  u 


w 


possesses  the  unique  solution 


(2) 


u(p)  ~J'  g(p,q)v(q)  +/’  g„(p,q)w(q), 

q€ R  qedR 


where  g  lo  the  Green's  function  for  R  normalized  by  the 
condition  that 


(3) 


y*  ^g(ppq)  gn(ppq)  -  1* 

q£S  qcas  ” 


Here  S  lo  any  sphere  with  center  p  which  lies  Inside  R, 

and  where  g^^  is  the  exterior  nc'-^l  derivative  of  g  on  9S. 

The  two  Integrals  In  (2)  represent  the  solutions  u^^^  and 
{o\ 

u'  '  to  the  boundary  value  problems 

u  •'0 
P 


(4) 


^u  •  V, 
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and 


!  (5) 


Au  -  0,  ■  w 

P 


respectively,  and  they  are  orthogonal  In  the  sense  that 

(6)  y* -  /*  u  - y -  0, 


an 

where  Is  the  gradient  of 


U<1).  1 


1,  2. 


3.  A  MINIMUM  PROBLEM 


d) 


Among  those  functions  u  such  that  u  *0,  the  function 

P 


u'  '  maximizes  the  Integral 


y  y  g(p,q)(Au-v)(p)(A\>-v)(q). 

p€R  qeR 


Hence,  since  the  maximum  value  Is  zero,  and  since 

(7)  y  g(p,qMu(q)  -  u(p) 

qc  R 


for  any  function  u  such  that  u^  ■  0,  one  obtains  an 
extremal  condition 


(8) 


utS  .0  -  utS  .0 

On  p  n 

•y  y  g(p,Q)v(p)v(q), 

p*R  qt  R 


with  the  minimizing  function  u^^^.  Define 

-w 

p  f' 


(9) 
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80  that 

(10)  f(v,0)  -  Z’  g(p,q)v(p)v(q). 

It  should  be  noted  that  the  first  equality  In  (8)  falls  for 
those  u  such  that  u^  -  w  /  0. 

Suppose  that  u'  '  Is  given  as  the  solution  of  (5)* 

Then  (9)  may  be  rewritten,  by  means  of  (6),  as 

-  Sin  -0  I’U 

P  R 

(11)  -  ^ 

p  R  n 

-  f(v,0)  S./’u^^^v  -t  /l7u^^^!^. 

In  particular,  writing  tw  In  place  of  w, 

(12)  f(v.tw)  -  f(v,0)  +  2t  /u<^>v  + 

R  ‘^R 

(2) 

Since  u'  '  Is  known  explicitly  In  terms  of  v/,  this  enables 
us  to  compute  the  Gateaux  difference 

(15)  f(v,tw)  -  f(v,0)  -  g„(p,q)v(p)w(q)  oit) . 

pc  R 

4.  A  FUNCTIONAL  EQUATION 

Let  ^  be  a  non-negative  function  of  class  on  3R, 

and  let  3R*  be  the  surface  obtained  from  GR  by  a  displace¬ 
ment  On  along  the  interior  normal,  where  On  *  If  u  Is 
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any  differentiable  function  on  R  such  that  u^  •  0,  then 

the  restriction  u  *  of  u  to  ^R*  Is  —  u^6n  -f  o(t).  We 

p  n 

extend  the  definition  of  f  to  the  class  of  regions  R*  with 
boundaries  R*  by  setting 

(14)  f(e,v,w)  .  '"I"  y’  [guv  +  |7u|^. 

R* 

o  p 

If  u  ■  0  then  Ivul  ■  u  on  ^R,  ao  that  the  n— dlmen— 
p  '  '  n  ' 

slonal  analog  of  the  principle  of  optimality  Implies 

(15)  f(0,v,O)  -  [f(t,v,-uyn)  6n  +  o(c)]. 

n  an 

Set  6f(v,w)  •  f(£,v,w)  -  f(0,v,w)  and  note  that 

(16)  5f(v,-u^6n)  -  6f(v,0)  + 

In  this  notation  one  may  apply  (13)  sjid  (15)  to  obtain 

(17)  "'J:'’  [6f(v,0)  -  g^/  y’  E.(p,q)v(p)5n(q)u  (q) 

^n  "poR  ^ 

^R 

The  Euler  variational  equation  of  (17)  Is 

(18)  e.,(p.q)v(p), 

peR 

and  It  follows  that 

(19)  Of(v,0)  -  /  /'  C>n(8)g  (p,8)g  (q,8)v(p)v(q)  -»■  o(^). 

8€^R  poP'qtR  ”  ” 
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5.  THH  HADAMARD  VARIATION 

g(^«p*Q)  represent  the  Green's  function  of  the 
region  R*,  and  let  &g(p»q)  •  g(t#P»q)  -g(0,p,q).  We  wish 
to  derive  the  Hadamard  relation  between  Sg  and  6n.  For  the 
region  R*  (10)  becomes 

(20)  f(^,v,0)  -y’  g(t,p,q)v(p)v(q), 

p€R*  qiR* 

ano  since  g  vanishes  and  possesses  a  bounded  nomal  deriva¬ 
tive  on  ^R  It  follows  that 

(21)  0f(v,0)  -y’  y’  Bs(p,q)v(p)v(q)  +  o(t). 

p€R  qtR 

Since  V  Is  arbitrary,  (19)  and  (21)  together  Imply 

(22)  Bg(p,q)  0n(8)g  (p,8)g  (q,B)  -t  o(t), 

sto^R  ^ 

which  Is  Hadamard 's  relation. 

The  preceding  derivation  Is  valid  only  when  R*  c.  R. 

To  prove  (25)  In  general  It  suffices  to  consider  R  and  R* 
as  regions  both  Interior  to  a  third  region  R,  and  to  consider 
the  difference  of  the  variation  of  to  R*  and  the  varia¬ 
tion  of  ??  to  R.  This  device  Is  due  to  Hadamard  and  Is  also 
applied  In  the  standard  derivation  of  (22). 

6.  LAPLACE-BELTRAMI  OPERATOR 

The  Hadamard  relation  remains  valid  If  A  is  replaced  by 
any  other  self-adjoint  second  order  differential  operator 
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vrhlch  possesses  a  Green's  function,  g.  Thus,  for  example, 

^  may  be  replaced  by  an  arbitrary  Laplace— Beltrami  operator 
merely  by  furnishing  R  with  an  appropriate  Rlemannlan  metric. 
In  this  case  there  Is  no  change  In  the  preceding  derivation. 

7.  INHOMOQSNSOUS  OPERATOR 

Alternatively,  we  may  add  a  multiplication  to  obtain  the 
operation  u  — >^u  4  a(p)u.  Assuming  that  a(p)  Is 
sufficiently  small,  we  may  again  consider  the  functional  f 

defined  by 

i 

(23)  f(v,w)  -  "Ij;  /[2UV  +  |Vu|2  -  ou^, 

i  p  R 

1 

I 

The  appropriate  orthogonality  relation  Is  now 

I 

i  .vu<2)  -y’  u  (Du  (D  - 

(2<t)  y’u(DQiu(2>  +  au(^b 

R 

I  •  0. 

f 

The  remainder  of  the  argument  proceeds  as  before. 

Since  the  varlatlona^  formula  Is  Independent  of  a,  one 
may  conclude  that  It  Is  valid  whenever  the  Green's  function 
exists. 
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